Custom Report

Author

Joseph H

1 Intoduction

This report is one of 493,845 that I will make, and one of 104,070,413 that could be made.
I “toke” the 1.4 TB Linked-In data that was breached in 2020, and turned it into some insights to power my job HUNT.
The insights I could share in this report, that are also related to my goals, are:
- Industry base recruitment trend.
- Company base workforce timeline.
- Current/part workforce info:
- Basic info: Name, job title, status, social link. I could add geo-location for some that have the data, but it would look creepy.
- Their work period.
- Their experiences.

2 About me

Salutations; I’m Joseph, a self-taught data analyst, engineer, and scraper.
Despite life’s challenges, my goal remains a remote job, either full or part-time, and having friends to tackle the challenges of this changing world with.
To show my skills and dedication, I made this project that yielded this tailored report.

3 About the project

3.1 How this project comes to life?

You would know by now, from my email, that I am hunting for a job.
About a year ago, I scraped contact info from Google Map to get my first job. Later I scraped contact from Linked-In website… you can check how that went in here.

Recently, I finally got to learning SQL because of DuckDB, it is a software that allows you to process big data in your local machine by using storage space as RAM; Then I remembered about a leaked Linked-In data that I couldn’t process.
Thus my journey started to learn SQL, process the data, and make something out of it.

3.2 The process

The process was done in my local machine, and it was as followed.

3.2.1 Downloaded the leaked data

I downloaded the data from a torrent.
There was around 700 .gz file, each is around 280 Mb; 196 GB in total.
Each .gz file contain a 2 GB file; 1.4 TB in total.
Each file have multiple lines, and each one of them is a JSON; Not the file is a JSON, it just have multiple JSONs, one in each line.

3.2.2 Processing the weird data

I this phase I created a script that automatically open an archive, process the file, and save it as a Parquet file with compression level of 22.
I used Python, Pathlib, Polars, and a lot of patience.
The process toke around 20 minutes per file, in total it toke around three weeks (I had to shutdown my PC at night) The result was 700 parquet files, each is around 190 Mb; 133 GB in total.

3.2.3 Making relational database

The data in the datasets were nested, especially the “experience” field, it had the experience of a person and the company info; The problem is that the company info get repeated multiple tiles, across all datasets.
Making a relational database will solve this, and make the exploratory data analysis easier.
The code was split in two:
1. I used Polars to split each of the 700 datasets into mini relational databases.
2. I used DuckDB to merge all the mini relational databases and remove duplicates in some, mainly company and university information’s.

The result was a relational database that is 73 GB in size; From 1.4 TB to 73 GB.

All of this is using my PC, so servers were harmed, only my CPU fan and my ear.

3.2.4 Filter

I filtered out companies base on their industry, country, and whether I have the email of one of the higher ups.

4 General graphs

4.1 market research indestry’s yearly new recruit count

4.2 metrixlab’s workforce status over the years

5 Workforce sample

5.1 Aditya Sinha

Job title: Client director
Associated: True
Socials: https://linkedin.com/in/aditya-sinha-46594215

5.1.1 Aditya Sinha’s working period at metrixlab

5.1.2 Gantt plot of Aditya Sinha’s experience

5.2 Alan Distassio

Job title: Research team leader - product innovation
Associated: True
Socials: https://linkedin.com/in/alandistassio

5.2.1 Alan Distassio’s working period at metrixlab

5.2.2 Gantt plot of Alan Distassio’s experience

5.3 Alexander Kleijngeld

Job title: Senior director, solution consultancy
Associated: True
Socials: https://linkedin.com/in/alexanderkleijngeld | https://linkedin.com/in/alexander-kleijngeld-67a22b1

5.3.1 Alexander Kleijngeld’s working period at metrixlab

5.3.2 Gantt plot of Alexander Kleijngeld’s experience

5.4 Anna Frano

Job title: Senior vice president, client partner
Associated: True
Socials: https://linkedin.com/in/anna-unger-frano-aa58363 | https://linkedin.com/in/anna-frano-aa58363

5.4.1 Anna Frano’s working period at metrixlab

5.4.2 Gantt plot of Anna Frano’s experience

5.5 Anthony Yuen

Job title: Associate director - team lead
Associated: True
Socials: https://linkedin.com/in/yuenanthony

5.5.1 Anthony Yuen’s working period at metrixlab

5.5.2 Gantt plot of Anthony Yuen’s experience

5.6 Arne Luteijn

Job title: Senior research manager | teamlead brand engagement
Associated: True
Socials: https://linkedin.com/in/arneluteijn

5.6.1 Arne Luteijn’s working period at metrixlab

5.6.2 Gantt plot of Arne Luteijn’s experience

5.7 Ashish Ubriani

Job title: Senior project manager
Associated: True
Socials: https://linkedin.com/in/ashish-ubriani-33a77414 | https://facebook.com/ashish.ubriani

5.7.1 Ashish Ubriani’s working period at metrixlab

5.7.2 Gantt plot of Ashish Ubriani’s experience

5.8 Barbara Du Perron

Job title: Director, global knowledge innovation consulting
Associated: True
Socials: https://linkedin.com/in/barbara-du-perron-1b0ba32 | https://facebook.com/barbara.duperron

5.8.1 Barbara Du Perron’s working period at metrixlab

5.8.2 Gantt plot of Barbara Du Perron’s experience

5.9 Benjamin Piper

Job title: Vice president
Associated: True
Socials: https://linkedin.com/in/benjamincpiper | https://linkedin.com/in/benjamin-piper-1b965 | https://facebook.com/ben.piper.3538 | https://klout.com/benjamincpiper | https://twitter.com/benjamincpiper

5.9.1 Benjamin Piper’s working period at metrixlab

5.9.2 Gantt plot of Benjamin Piper’s experience

5.10 Biswaroop Chatterjee

Job title: Director
Associated: True
Socials: https://linkedin.com/in/biswaroop-chatterjee-b67a4028

5.10.1 Biswaroop Chatterjee’s working period at metrixlab

5.10.2 Gantt plot of Biswaroop Chatterjee’s experience

5.11 Campbell Fitch

Job title: Global human resources director
Associated: False
Socials: https://linkedin.com/in/campbell-fitch-9512446

5.11.1 Campbell Fitch’s working period at metrixlab

5.11.2 Gantt plot of Campbell Fitch’s experience

5.12 Dan Campbell

Job title: Vp, brand engagement and innovation solutions
Associated: False
Socials: https://facebook.com/daniel.r.campbell | https://linkedin.com/in/dcampbellbrandresearch | https://linkedin.com/in/dancampbellny | https://linkedin.com/in/dan-campbell-49610a | https://linkedin.com/in/dancampbelladmeasurement | https://twitter.com/dsoupbone | https://angel.co/dan-campbell-2

5.12.1 Dan Campbell’s working period at metrixlab

5.12.2 Gantt plot of Dan Campbell’s experience

5.13 Dan Kent-Smith

Job title: Client director
Associated: True
Socials: https://linkedin.com/in/dan-kent-smith-a8352512 | https://linkedin.com/in/dankentsmith

5.13.1 Dan Kent-Smith’s working period at metrixlab

5.13.2 Gantt plot of Dan Kent-Smith’s experience

5.14 Edwin Van Der Harst

Job title: Client director
Associated: True
Socials: https://linkedin.com/in/edwin-van-der-harst-2b96781 | https://linkedin.com/in/edwinvanderharst

5.14.1 Edwin Van Der Harst’s working period at metrixlab

5.14.2 Gantt plot of Edwin Van Der Harst’s experience

5.15 Emanuele Carioti

Job title: Opinionista opionionbar.com - metrixlab nederland b v
Associated: False
Socials: https://twitter.com/emanuelecarioti | https://linkedin.com/in/emanuele-carioti-61333718 | https://facebook.com/emanuelecarioti

5.15.1 Emanuele Carioti’s working period at metrixlab

5.15.2 Gantt plot of Emanuele Carioti’s experience

5.16 Erika Roman

Job title: Senior research manager
Associated: True
Socials: https://linkedin.com/in/erikaroman

5.16.1 Erika Roman’s working period at metrixlab

5.16.2 Gantt plot of Erika Roman’s experience

5.17 Esther Heuvelman

Job title: Director methods and process
Associated: True
Socials: https://linkedin.com/in/esther-heuvelman-38b8907

5.17.1 Esther Heuvelman’s working period at metrixlab

5.17.2 Gantt plot of Esther Heuvelman’s experience

5.18 Eva Van Dueren Den Hollander

Job title: Stagiair
Associated: True
Socials: https://linkedin.com/in/eva-van-dueren-den-hollander-8066b1151

5.18.1 Eva Van Dueren Den Hollander’s working period at metrixlab

5.18.2 Gantt plot of Eva Van Dueren Den Hollander’s experience

5.19 Gayatri Srikant

Job title: Managing director
Associated: True
Socials: https://linkedin.com/in/gayatri-srikant-89658a20 | https://facebook.com/gayatri.srikant

5.19.1 Gayatri Srikant’s working period at metrixlab

5.19.2 Gantt plot of Gayatri Srikant’s experience

5.20 Gina Eckardt

Job title: Senior qualitative research manager
Associated: True
Socials: https://linkedin.com/in/gina-eckardt-5a253813

5.20.1 Gina Eckardt’s working period at metrixlab

5.20.2 Gantt plot of Gina Eckardt’s experience

5.21 Goutham Goli

Job title: ****
Associated: True
Socials: https://linkedin.com/in/goutham-goli-6a6616141

5.21.1 Goutham Goli’s working period at metrixlab

5.21.2 Gantt plot of Goutham Goli’s experience

5.22 Greg Bontempo

Job title: Senior project manager
Associated: True
Socials: https://linkedin.com/in/gregorybontempo

5.22.1 Greg Bontempo’s working period at metrixlab

5.22.2 Gantt plot of Greg Bontempo’s experience

5.23 Hans Van Lochem

Job title: Director
Associated: True
Socials: https://linkedin.com/in/hans-van-lochem-3996b75

5.23.1 Hans Van Lochem’s working period at metrixlab

5.23.2 Gantt plot of Hans Van Lochem’s experience

5.24 Hans Verhulst

Job title: Global human resources director
Associated: True
Socials: https://linkedin.com/in/hans-verhulst-4591b22 | https://twitter.com/hansverhulst | https://linkedin.com/in/hansverhulstgfk

5.24.1 Hans Verhulst’s working period at metrixlab

5.24.2 Gantt plot of Hans Verhulst’s experience

5.25 Helene Pavlidis

Job title: Vice president
Associated: True
Socials: https://linkedin.com/in/helenepavlidis

5.25.1 Helene Pavlidis’s working period at metrixlab

5.25.2 Gantt plot of Helene Pavlidis’s experience

5.26 Hilary Gaines

Job title: Senior director, global knowledge and innovation consultancy
Associated: True
Socials: https://linkedin.com/in/hilary-gaines-8708367

5.26.1 Hilary Gaines’s working period at metrixlab

5.26.2 Gantt plot of Hilary Gaines’s experience

5.27 Jan Philippa

Job title: Relationship director
Associated: True
Socials: https://linkedin.com/in/jan-philippa-0061972

5.27.1 Jan Philippa’s working period at metrixlab

5.27.2 Gantt plot of Jan Philippa’s experience

5.28 Jasen Holness

Job title: Senior vice president - agency and media practice
Associated: True
Socials: https://linkedin.com/in/jasen-holness-47944a28

5.28.1 Jasen Holness’s working period at metrixlab

5.28.2 Gantt plot of Jasen Holness’s experience

5.29 Jason Walker

Job title: Team leader - product innovation
Associated: True
Socials: https://linkedin.com/in/jason-walker-bbb4225

5.29.1 Jason Walker’s working period at metrixlab

5.29.2 Gantt plot of Jason Walker’s experience

5.30 Jay Pluhar

Job title: Executive vice president - global knowledge innovation consulting
Associated: True
Socials: https://linkedin.com/in/jay-pluhar-403297

5.30.1 Jay Pluhar’s working period at metrixlab

5.30.2 Gantt plot of Jay Pluhar’s experience

5.31 Kathy Relias

Job title: Regional vice president
Associated: False
Socials: https://linkedin.com/in/kathy-relias-9675913 | https://linkedin.com/in/kathleen-relias-9675913

5.31.1 Kathy Relias’s working period at metrixlab

5.31.2 Gantt plot of Kathy Relias’s experience

5.32 Lauren Geissler

Job title: Senior research manager
Associated: True
Socials: https://linkedin.com/in/lauren-geissler-aa710428

5.32.1 Lauren Geissler’s working period at metrixlab

5.32.2 Gantt plot of Lauren Geissler’s experience

5.33 Leandro Papone

Job title: Business development manager ebusiness research
Associated: True
Socials: https://linkedin.com/in/leandro-papone-3802ab2

5.33.1 Leandro Papone’s working period at metrixlab

5.33.2 Gantt plot of Leandro Papone’s experience

5.34 Marco Pasqualina

5.34.1 Marco Pasqualina’s working period at metrixlab

5.34.2 Gantt plot of Marco Pasqualina’s experience

5.35 Margriet Brand

Job title: Senior research manager and teamleader product innovation
Associated: True
Socials: https://linkedin.com/in/margriet-brand-73219a6

5.35.1 Margriet Brand’s working period at metrixlab

5.35.2 Gantt plot of Margriet Brand’s experience

5.36 Marieke Sijbertsma-Meerbeek

Job title: Research manager and team leader media and advertising
Associated: False
Socials: https://linkedin.com/in/marieke-sijbertsma-meerbeek-b467227

5.36.1 Marieke Sijbertsma-Meerbeek’s working period at metrixlab

5.36.2 Gantt plot of Marieke Sijbertsma-Meerbeek’s experience

5.37 Marko Kalis

Job title: Team leader product innovation
Associated: True
Socials: https://facebook.com/markokalis | https://linkedin.com/in/markokalis

5.37.1 Marko Kalis’s working period at metrixlab

5.37.2 Gantt plot of Marko Kalis’s experience

5.38 Marla Wert

Job title: Vice president, client director
Associated: False
Socials: https://linkedin.com/in/marlawert

5.38.1 Marla Wert’s working period at metrixlab

5.38.2 Gantt plot of Marla Wert’s experience

5.39 Martin Ash

Job title: Group lead, entertainment sector
Associated: True
Socials: https://twitter.com/dynamicmarty | https://linkedin.com/in/martin-ash-56621329

5.39.1 Martin Ash’s working period at metrixlab

5.39.2 Gantt plot of Martin Ash’s experience

5.40 Maurits Moti

Job title: Client director
Associated: True
Socials: https://linkedin.com/in/maurits-moti | https://twitter.com/mauritsmoti | https://linkedin.com/in/maurits-moti-00442522

5.40.1 Maurits Moti’s working period at metrixlab

5.40.2 Gantt plot of Maurits Moti’s experience

5.41 Michele Mcdonald

Job title: Group senior vice president
Associated: True
Socials: https://linkedin.com/in/michelemcdonald

5.41.1 Michele Mcdonald’s working period at metrixlab

5.41.2 Gantt plot of Michele Mcdonald’s experience

5.42 Michelle De Montigny

Job title: Evp, us and global commercial strategy
Associated: True
Socials: https://facebook.com/michelle.demontigny | https://linkedin.com/in/michelle-de-montigny-91abb81

5.42.1 Michelle De Montigny’s working period at metrixlab

5.42.2 Gantt plot of Michelle De Montigny’s experience

5.43 Michelle O’Neill

Job title: Senior vice president, client strategy
Associated: False
Socials: https://linkedin.com/in/michelleoneill42

5.43.1 Michelle O’Neill’s working period at metrixlab

5.43.2 Gantt plot of Michelle O’Neill’s experience

5.44 Mike Nugent

Job title: Vice president, client director
Associated: True
Socials: https://linkedin.com/in/mike-nugent-815b3b3

5.44.1 Mike Nugent’s working period at metrixlab

5.44.2 Gantt plot of Mike Nugent’s experience

5.45 Mohammed Basha

Job title: Senior .human resources
Associated: True
Socials: https://linkedin.com/in/mohammed-khaleel-a3548420

5.45.1 Mohammed Basha’s working period at metrixlab

5.45.2 Gantt plot of Mohammed Basha’s experience

5.46 Monica Reed

Job title: Senior project manager and global sourcing
Associated: True
Socials: https://linkedin.com/in/reedmonica | https://linkedin.com/in/monica-reed-00788510

5.46.1 Monica Reed’s working period at metrixlab

5.46.2 Gantt plot of Monica Reed’s experience

5.47 Pieter Van Der Gouwe

Job title: Managing director at metrixlab
Associated: True
Socials: https://linkedin.com/in/ptvandergouwe | https://linkedin.com/in/pieter-van-der-gouwe-a2a2295

5.47.1 Pieter Van Der Gouwe’s working period at metrixlab

5.47.2 Gantt plot of Pieter Van Der Gouwe’s experience

5.48 Pim Van Leeuwen

Job title: Director of client strategy and growth
Associated: True
Socials: https://linkedin.com/in/pimleeuwen

5.48.1 Pim Van Leeuwen’s working period at metrixlab

5.48.2 Gantt plot of Pim Van Leeuwen’s experience

5.49 Robert Wilhelm

Job title: Board member and investor
Associated: False
Socials: https://linkedin.com/in/robertwilhelm | https://twitter.com/rpwilhelm | https://linkedin.com/in/robert-wilhelm-b01107 | https://facebook.com/robert.wilhelm.nl

5.49.1 Robert Wilhelm’s working period at metrixlab

5.49.2 Gantt plot of Robert Wilhelm’s experience

5.50 Samantha Muscia

Job title: Senior research manager and product innovation team leader
Associated: True
Socials: https://linkedin.com/in/samantha-muscia-82349a5b | https://facebook.com/samantha.muscia

5.50.1 Samantha Muscia’s working period at metrixlab

5.50.2 Gantt plot of Samantha Muscia’s experience

5.51 Samy Boudjedra

Job title: Senior vice president sales
Associated: True
Socials: https://linkedin.com/in/samy-boudjedra-2b791a4

5.51.1 Samy Boudjedra’s working period at metrixlab

5.51.2 Gantt plot of Samy Boudjedra’s experience

5.52 Sanne Handgraaf

Job title: Research manager product innovation
Associated: True
Socials: https://linkedin.com/in/shandgraaf

5.52.1 Sanne Handgraaf’s working period at metrixlab

5.52.2 Gantt plot of Sanne Handgraaf’s experience

5.53 Selin Varol

Job title: Senior research manager and social insights consultant
Associated: True
Socials: https://linkedin.com/in/svarol | https://linkedin.com/in/selin-varol-26379341

5.53.1 Selin Varol’s working period at metrixlab

5.53.2 Gantt plot of Selin Varol’s experience

5.54 Shireen Abad

Job title: Stagiair
Associated: True
Socials: https://linkedin.com/in/shireen-abad

5.54.1 Shireen Abad’s working period at metrixlab

5.54.2 Gantt plot of Shireen Abad’s experience

5.55 Thijs Elias

Job title: Director sales and marketing
Associated: True
Socials: https://linkedin.com/in/thijs-elias-6ab1b

5.55.1 Thijs Elias’s working period at metrixlab

5.55.2 Gantt plot of Thijs Elias’s experience

5.56 Thijs Elias

Job title: Chief executive officer at metrixlab and executive officer at macromill inc
Associated: True
Socials: https://linkedin.com/in/thijs-elias-440210

5.56.1 Thijs Elias’s working period at metrixlab

5.56.2 Gantt plot of Thijs Elias’s experience

5.57 Vinay Rao

Job title: Senior client director
Associated: True
Socials: https://linkedin.com/in/vinayraometrixlab | https://linkedin.com/in/vinay-rao-19703811

5.57.1 Vinay Rao’s working period at metrixlab

5.57.2 Gantt plot of Vinay Rao’s experience

5.58 Vincent Blaney

Job title: Managing director - australia and new zealand
Associated: True
Socials: https://linkedin.com/in/vincentblaney | https://linkedin.com/in/vincent-blaney-59a42016

5.58.1 Vincent Blaney’s working period at metrixlab

5.58.2 Gantt plot of Vincent Blaney’s experience

5.59 Vincent Borst

Job title: Client director
Associated: False
Socials: https://linkedin.com/in/vincent-borst-059844

5.59.1 Vincent Borst’s working period at metrixlab

5.59.2 Gantt plot of Vincent Borst’s experience

5.60 Walter Idema

Job title: Research manager npd and shopper research
Associated: True
Socials: https://linkedin.com/in/walter-idema-b2230b9